Standards-based assessment

A standards based test is one based on the outcome-based education or performance-based education philosophy.^[1] Assessment is a key part of the standards reform movement. The first part is to set new, higher standards to be expected of every student. Then the curriculum must be aligned to the new standards. Finally, the student must be assessed if they meet these standards of what every student "must know and be able to do". In the United States, a high school diploma which is given on passing a high school graduation examination or Certificate of Initial Mastery is awarded only when these standards are achieved.

A criterion is set up for standards of what every student or child is expected to know, and a score is set compared to these benchmarks rather than a ranking compared to a norm. It is fully expected that every child will become proficient in all areas of academic skills by the end of a period, typically 10 years in the United States, but sometimes longer, after the passing of education reform bill by a state legislature. The United States federal government, under No Child Left Behind can further require that all schools must demonstrate improvement among all students, even if they are already all over proficient.

Holistic grading

Rather than using computers to log responses to multiple choice tests, rubrics for state assessments such as in North Carolina ^[2] ask scorers to look at the entire paper and make judgments. Scorers are not allowed to count errors, and rubrics do not contain numeric measurements of how many spelling or grammar error constitute a "1" or "2". The Analytical Writing section of the GRE test is scored using the a six-point holistic scale in half-point increments.^[3] Holistic grading is one of the main reason for disagreement between scorers, but for this reason some tests are scored more than once to check for agreement.

Advantages

• Students are compared to a standard that all can reach, rather than artificially ranked into a bell curve where some students must be called failures, and only a few are allowed to succeed
• Humans, not computers can evaluate the entire value of a response rather than imposing a strict right or wrong that is not open to interpretation
• Free response uses and tests for higher order thinking, which is important in most new education standards.
• Computer scored multiple choice tests have been shown to have deleterious effects for minorities, unfairly denying opportunities.
• A criterion-based test is a test worth teaching to, unlike a multiple choice test.
• Only a standards based test is aligned with standards based education reform, which is based on a belief that all students can succeed, not only a few.
• Passing a 10th grade test and awarding a Certificate of Initial Mastery ensures that all students will graduate with the skills they need to succeed in the world-class economy of the twenty-first century.
• Students will no longer be cheated by passing them on to the next grade without obtaining what every child at the grade level must be able to know and do.
• When all students pass all standards, as is the central belief of standards based education reform, all students from all demographics will achieve the same test score, eliminating the mysterious achievement gap which has previously been shown to occur between all groups on all tests. However, as of 2006, no standards based assessment has yet achieved this optimistic (critics might call it impossible) goal, though many show rising scores.

Comparison

Compared to a multiple-choice, norm-referenced test, a standards based test can be recognized by:

• A cut score is determined for different levels of performance. There are no cut scores for norm-referenced tests. There is no failing score on the SAT test. Each college or institution sets their own score standards for admission or awards.
• Different levels of performance are set. Typically these are Above Standard, Meets Standard, Below Standard. These levels are typically set in a benchmarking process, even though such a process does not take into an account whether the test items are even appropriate for the grade level.
• Tests are holistically graded against a free-written response, often with pictures, rather than graded correct or incorrect among multiple choices.
• Tests are more expensive to grade because of this, typically $25–30 per test compared to $2–$5, not including the cost of developing the test, typically different every year for every state.
• Tests are more difficult to grade because they are typically graded against a handful with no more than one or two example papers at each scoring level. They cannot be graded by computer
• Tests are less reliable. Agreement may fall between 60 to 80 percent on a 4 point scale and be considered to be accurate.
• Graders do not need teaching credentials, only a bachelor's degree in any field, and are typically paid $8 to $11 per hour for part time work.
• Failure rates as high as 80 to 95 percent are not only not unusual, they are fully expected and announced as test programs are introduced to the local press. Under traditional graduation criteria, African Americans had achieved national graduation rates within a few points of whites. In 2006, three-quarters of African Americans who failed the WASL were promised by Superintendent Terry Bergeson that they would not get a diploma if they did not pass retakes of the test in two years, even though she had pledged earlier that "all students" would get a world class diploma.
• Failure rates for minorities and special education students are typically two to four times higher than for majority groups as extended response questions are more difficult to answer than multiple choice
• Content is often difficult even for adults to quickly answer, even at grade levels as low as the fourth grade, especially in mathematics. Professor Don Orlich called the WASL a "disaster", with math and science tests falling well above the normal development level of students at many grade levels.
• Mathematics has a high proportion of statistics and geometry, and a low content of simple arithmetic.
• Schools are scored as zero for students who do not take the test.
• Passing such a test at the 10th grade level is typically planned as being required for graduating high school.
• Passing such a test, rather than the 50th percentile, is defined as grade level performance.
• A question with a correct answer may be graded as incorrect if it does not show how the answer as arrived at. A question with an incorrect numerical conclusion may not necessarily be graded as wrong.^[4]
• California's first year of the CLAS test permitted no '4' high math grades, not even in the highest scoring schools, in order to leave room for improvement^[5]
• The North Carolina Writing project gave out less than 1 percent exemplary '4' scores. Such papers employed vocabulary and knowledge on a level sometimes exceeding that of the college graduate graders, and well above the intended audience of a high school graduation.^[6] This level would be even more difficult than achieving an SAT score sufficient for entry into an Ivy League private college.
• Scores typically rise much faster than standardized tests such as NAEP or SAT given over the same time period.^[7]

Washington Classroom-Based Performance Assessment (WCBPA)

In order to address concerns that only math, science, reading and writing will be assessed, Washington state has created classroom based assessments in many fields have been created and piloted by actual students

Arts

In music, 5th graders are asked to sight sing from sheet music. They may use solfege, scale numbers, or fingering without an instrument. Songs must be sung with a steady beat, correct pitch and correct rhythmic value. A 0 point response will result with six or more rhythmic errors or not maintaining a steady beat. Each student will have one minute to study and practice the sight-singing exercise. Then there will be two opportunities to perform while being videotaped. They are also expected to compose on demand a theme using blank staff paper, and perform it on an instrument.

In dance, the state expects that all 5th graders can interpret a piece of visual art by creating and performing an original dance. A jumping jack "X" must be fully extended, a wilted "X" is not acceptable. Ending in a shape must be held for 3 seconds. Dances must perform in bare feet or appropriate dancing shoes. The student has 20 minutes to create and rehearse their dance, and must describe two ideas, images, or feelings and explain why he or she chose the movement or movement phrase.

See also

• Concept inventory
• Educational assessment
• Massachusetts Comprehensive Assessment System
• Rubrics for assessment
• Standards based education reform
• Washington Assessment of Student Learning

References

1. ^ [1] January 18, 2006 Standards- Based Test draws plan for awareness Jackie Schlotfeldt News-Bulletin Staff Writer Valencia County News-Bulletin "With the New Mexico Standards Based Assessments just a little over a month away"
2. ^ AFT - Hot Topics - Standards-Based Reform North Carolina Focused Holistic Scoring Guide: The Expository Composition Grade 7, [2]
3. ^ GRE Update - March 2006 The Analytical Writing section of the General Test will continue to be scored using the six-point holistic scale in half-point increments [3]
4. ^ 1997 WASL math released problems
5. ^ testimony of Maureen DiMarco to Washington State legislators
6. ^ At a grading session in Auburn in 2004, no graders could identify some of the words used in some papers
7. ^ Rand study of Kentucky KIRIS

External links

• American Federation of Teachers. Where We Stand: Standards-Based Assessment and Accountability
• "How the WASL is Awful", publication distributed by Citizens United for Responsible Education, Washington State.